Pushing Bytes: Cloud Scale Big-Data Replication with RDMC

Cloud computing frameworks replicate large objects for diverse reasons, often under time-pressure. RDMC (Reliable DMA Multicast) is a reliable data replication protocol that runs at exceptionally high speeds and low latencies, implementing multicast as a pattern of RDMA unicast operations using a novel approach that maximizes concurrency. Users with knowledge of datacenter topology can configure RDMC to use a pattern of data flow matched to the network. In networks with full bisection bandwidth our fastest protocol creates a collection of binomial trees and embeds them on a hypercube overlay, setting speed records while also achieving exceptionally low delivery-time skew.